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ABSTRACT 

Aims. In 1914, Eddington derived a formula for the difference between the mean absolute magnitudes of stars ”in 
space” or gathered ’’from the sky”. Malmquist (1920) derived a general relation for this difference in Euclidean space. 
Here we study this statistical bias in cosmology, clarifying and expanding previous work. 

Methods. We derived the Malmquist relation within a general cosmological framework, including Friedmann’s model, 
analogously to the way Malmquist showed in 1936 that his formula is also valid in the presence of extinction in Euclidean 
space. We also discuss some conceptual aspects that explain the wide scope of the bias relation. 

Results. The Malmquist formula for the intrinsic difference (M) m — Mo = —&m d ^ a ^ so va hd for observations 
made in an expanding Friedmann universe. This is holds true for bolometric and finite-band magnitudes when a(m) 
refers to the distribution of observed (uncorrected for K-effect or 2 -dependent extinction) apparent magnitudes. 

Key words. Methods: statistical - Galaxies: distances and redshifts - Cosmology: distance scale 


1. Introduction 

Although not an astronomer, but a philosophical and cos¬ 
mological thinker, Giordano Bruno already understood that 
our fixed position in the Universe leads to problems for the 
observer. When he discussed his vision of the cosmos filled 
with stars and planetary systems, he pointed out some rea¬ 
sons why we cannot see all those planets: 1) they may be too 
faint, 2) they may be too far away, and 3) they may reflect 
the light of their central star only poorly (in the third dialog 
of his book Of the infinite universe and worlds, 1584). 

Thus Bruno was faintly aware of some selection effects 
that make the life (or at least the task) of an astronomer 
difficult. Before the telescopic era, Bruno had in mind vi¬ 
sual observations, but similar problems affect observations 
made with instruments. The fact that celestial bodies have 
a range of luminosities and are scattered in space leads to 
interesting effects that the observer should take into ac¬ 
count. 

1.1. Eddington's contribution 

In his book Stellar movements and the structure of the 
universe, Eddington (I1914j) discusses in the chapter 
’’Phenomena associated with spectral type” among other 
topics the distribution of stars in the Hertzsprung-Russel 
(HR) diagram (absolute magnitude vs. spectral type) that 
had recently been introduced by Hertzsprung and Russell. 
They had proposed the existence of ’’giant” and ’’dwarf’ 
stars. Eddington begins by considering what happens when 
one chooses Type A and Type M stars ”at random out of 
the stars in space”, and then he says: 

We say intentionally ’’out of the stars in space”, be¬ 
cause, for example, the stars visible to the naked eye are a 
very special selection by no means representative of the true 
distribution of the stars. 


When discussing the reality of the dwarfs and giants di¬ 
vision, Eddington then ponders the possibility of a selection 
effect. As the stars for which the parallaxes had been de¬ 
rived had been chosen either for brightness or for nearness 
(large proper motion), he asks if the two groups might re¬ 
sult ’’from the double mode of selection, without implying 
any real division in the intrinsic luminosities”. 

Then he shows in a few strokes that for a normal distri¬ 
bution of absolute magnitudes M with the mean and 
the dispersion l/fi/2k) (his notation), the frequency of M 
among stars in a magnitude-limited sample is a normal dis¬ 
tribution with the same dispersion, but a brighter mean 
value Mo — 0.69/fc 2 . With this formula at hand, Eddington 
shows that to explain in this way the wide gap of 11 mag 
between giants and dwarfs for the M spectral type would 
require a dispersion of almost 3 mag, while Russell had de¬ 
rived a mean value of 1.14 mag for all spectral types. Thus 
he concludes that the selection effect, which he had just 
discovered, cannot explain dwarfs and giants. 

In the current notation Eddington’s formula is written 

(M) = M 0 - 1.382(7^, (1) 

where ( M) is the mean absolute magnitude when a stellar 
class with a Gaussian luminosity function (LF) (Mo = the 
mean absolute magnitude, ctm = the dispersion) is sampled 
from the sky as a magnitude-limited sample. Such a class 
may be called a Gaussian standard candle. 

1.2. General Malmquist formula 

Equation (1) is valid for a homogeneous spatial distribu¬ 
tion. It is a special case of the more general formula derived 
by Malmquist ( 192Q[ 11922 ). He investigated how the lumi¬ 
nosity function (LF) of A-type stars may be derived from 
their distances (in fact, proper motions), provided that it 
is Gaussian and one knows the distribution a(m ) of appar¬ 
ent magnitudes up to a limiting magnitude. One result was 
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the Malmquist formula for the mean value of M of a sam¬ 
ple gathered through the apparent magnitude ’’window” 
m ± ^d m: 

., , o din afro) 

(M) m = Mo — cr M ——■ (2) 

The a(m) term in Eq.(2) depends on the spatial distribu¬ 
tion of stars. It has a simple constant form, when the num¬ 
ber density reads r _ “, where r is the distance: ( M) m = 
M 0 — (3 — a)0.461(7^. With a = 0, the Eddington Eq. (1) 
is obtained. A strongly thinning density with a = 3 is re¬ 
quired for no bias, (. M) m = M 0 . Then the large volume at 
large distances, which contributes high-luminosity stars to 
the sample, is fully compensated for by the lower number 
density of stars. 


An early work on the Malmquist bias in cosmology was 
made by Bigot & Triay (il990ll . kindly communicated by 
them to us after the paper T98 was published. The present 
discussion should facilitate access to their technical treat¬ 
ment, where one result is the Malmquist integral relation, 
Eq.(3), and where they conclude that the constant correc¬ 
tion (Eq. (1)) is no longer valid for distant objects. 

Here we derive the general formula using the cosmolog¬ 
ical route, but analogously to the way Malmquist (|1936|) 
remarkably showed that Eq.(2) is valid not only in trans¬ 
parent Euclidean space, but also in the presence of inter¬ 
stellar extinction. We first assume fully transparent space 
and start with the differential bias (Eq. (2)), whose deriva¬ 
tion illustrates well the classical and cosmological aspects 
of the bias and from which it is easy to derive the integral 
bias. 


1.3. About terminology 

The Eddington-Malmquist (or Malmquist) bias refers to 
the major difference in sampling luminous objects ’’from 
space” versus ’’from sky”. The Malmquist relation is the 
general Eq. (2), while the Eddington formula is the special 
case, Eq. (1). 

Butkevich et al. (120051) termed the bias in Eq.(2) differ¬ 
ential, while integral bias was used to denote Malmquist’s 
other formula, 


(Af)i n t — Mq — <j\f 


din A(roi im ) 
droi im 


(3) 


where (M) i nt is the mean for the whole magnitude-limited 
sample and A(m) is the cumulative distribution up to the 
magnitude limit roii m . 

When standard candle data are inspected as (M) vs. m 
or (M) vs. r (r = distance), respective biases of Type 1 
and Type 2 appear (as reviewed by Teerikorpi 1199? ', espe¬ 
cially Table I therein), which were also called classical and 
distance-dependent by Sandage (119941) . 

Type 1 relates to the bias treated here, that is, how 
(M) m differs from Mq. Type 2 refers to the magnitude cut¬ 
off effect when for instance a Hubble diagram is inspected 
as ro versus log 2 . Often the Type 2 aspect is also called, a 
little misleadingly, the Malmquist bias. 

Another parameter is the Eddington bias, which de¬ 
notes the influence of random measurement errors on de¬ 
rived distribution functions (Eddington 11913 . 194 01. The 
Eddington bias was discussed by Teerikorpi (|2004[) . who 
also considered how it works in concert with the Malmquist 
bias, Eq.(2). 

We derive in Sect. 2 the Malmquist relation in a general 
cosmological context, first using the bolometric magnitude 
and then for a finite-band magnitude. In Sect. 3, the result 
is illustrated and compared with our earlier studies. Section 
4 contains concluding remarks. 


2. Malmquist equation in a cosmological context 

We have previously discussed cosmological Malmquist bias 
in the Hubble diagram at high redshifts (Teerikorpi [1998), 
120031 or T98, T03). This was made by calculating the be¬ 
haviour of the average (logz) m for a Gaussian standard 
candle, taking into account the different foreground and 
background volumes as given by Friedmann models. The 
Malmquist formula was not directly considered. 


2.1. Bolometric magnitude 


We begin with the necessary formulae using the bolometric 
magnitude. Instead of the classical distance, we use the red- 
shift ^ as the parameter indicating the distance. Then the 
observed apparent (bolometric) magnitude ro is related to 
the absolute (bolometric) magnitude M as M = m — p(z), 
where p(z) is the Friedmann model-dependent distance 
modulus of an object at redshift 2 . Q 

We consider a class of objects with a Gaussian LF >1>(M) 
for the bolometric magnitudes. Then the number of objects 
in the sky observed with the apparent magnitude ro. ± \dm 
(differential counts) may be obtained using the analogue of 
the equation of von Seeliger (118981) , now summing over the 
redshift: 


a(ro)dro =— / <!>(ro — p(z))p(z) — — dzdm, 

47T ./n dz 


(4) 


where p{z) gives the co-moving spatial number density of 
objects, possibly varying as a function of redshift, V(z ) is 
the co-moving volume up to redshift z, and ui is the solid 
angle covered by the region under survey (4A j s the co¬ 
moving volume derivative). 

By derivation, one obtains another needed expression 


da(ro) oj d<f>(ro — p(z)) dU 

= — plz) ^ iz 


(5) 


Using Eq.(4), the average value of the absolute magnitude 
of the objects observed at ro ± \dm reads 


(M) m a(m) = — 
47T 



p(z))$(m 


d{z))p{z)^-dz.(d) 


Inserting the Gaussian LF, Eq. (5) becomes 


da(r 


dm 


OJ 

47T 


——^- —d>(m - p{z))p{z)^-dz 


M 


dz 


o 

from which one finally obtains 
2 dlna(ro-b) 


=- \-{(M) rn a(m) - M 0 a(ra))(7) 


M 


(Mb) m b = Mob — cr 


M~ 


drob 


( 8 ) 


1 One may write p(z) = 5 log n um (z)/10pc. The luminosity 
distance n um (z) is obtained using the well-known Mattig equa¬ 
tion and its generalizations (e.g., Baryshev & Teerikorpi 120121) . 
once the values of the Friedmann model parameters are fixed. 
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where b means that the magnitudes are bolometric. 
Equation (8) is the same as the classical Malmquist for¬ 
mula. Below we discuss some further aspects of the result. 


2.2. K-correction K(z) and extinction E(z) 


The above derivation, with the bolometric magnitude 
in cosmology, corresponds to the case of transparent 
Euclidean space in Malmquist’s original study, where the 
apparent magnitude could be bolometric or finite-band (no 
redsliift). 

In practice, a finite-band magnitude To; is measured 
that gives rise to a redshift-dependent K-effect Ki(z). In 
that case, one replaces M = m — p(z) by Mj iC = rrii — 
Ki(z ) — n(z), and the end result is similar to Eq.(8), now 
for the K-corrected M^-magnitude Mj >c and the observed 
to* magnitude: 




— Mo — cr 2 M 


dlna(?7ii) 

d?rii 


(9) 


We emphasize a subtlety in the magnitudes in Eq.(9). The 
difference (Mi jC } mi — Mjo indicates how much the mean 
value of the intrinsic (K-corrected) absolute magnitude of 
the objects at the observed apperent magnitude m, differs 
from the actual mean of the Gaussian LF. In the right- 
side expression, the distribution a{m\) is that of the ob¬ 
served (uncorrected) apparent magnitude. 

Adding a ^-dependent extinction E{z) to the model 
(Mj )C = mi — Ki(z) — E(z) — p{z)) leads to the same result. 

The symbol m may designate either a bolometric or (as 
in practice) a finite-band magnitude in the remaining text. 


2.3. Integral relation 

In the integral bias the relevant variable is the limiting mag¬ 
nitude m\i m up to which the sample is complete in the 
inspected region of the sky (in the derivation of the differ¬ 
ential bias it is not required that the sample is complete in 
this sense). Then up to m\i m , the number of objects is 

/ ™lim 

a(m)dm, (10) 

-OO 

and the mean absolute magnitude for the whole sample is 


/ ^Mim 

(M) m a(m)dm. (11) 

-OO 

From what was discussed above, we know what ( M) m 
is (i.e., Eq.(9)) both classically and cosmologically for a 
Gaussian LF, and inserting this into Eq.(ll) results in 

(M) int A(mii m ) = M 0 A(mi im ) - a 2 M dy ^ TOlim ) ; (12) 

dmihn 

from which follows Eq.(3). 

It is interesting to note that the Malmquist differential 
and integral relations also apply to the extreme spatial dis¬ 
tribution z = constant. This is considered in Appendix A. 


2.4. Malmquist relation via convolution 

The Malmquist relation can also be considered via convo¬ 
lution. Namely, the distribution a(m) results from a con¬ 
volution of a Gaussian function $ and a function F when 


(e.g., in the cosmological context) one considers the dis¬ 
tance modulus /j as a variable instead of z. Then 

f w = (w) 

pOO 

a(m) = / <!>(to — p)F(p)dp = ($ * F)(m), and (14) 


A M m 


2 din ($ * F)(m) 
dm 


(15) 


Here we have the essential mathematical reason for the 
wide scope of the Malmquist relation because it is based on 
the simple Gaussian convolution of the function F, which 
carries all cosmological factors (geometry, luminosity dis¬ 
tance, possible number density evolution), and the distance 
modulus fi may be viewed as a dummy integration variable. 
With the K-effect (Sect.2.2), the new variable is constructed 
from p(z) + K{z), which is normally a monotonically in¬ 
creasing function. □ 


3. Discussion 

To illustrate the result in a concrete way, it is instructive 
to make numerical calculations of the left and right sides of 
the Malmquist equation in Friedmann space. 

3.1. Illustrations of the result 

For example, consider a class of Gaussian standard can¬ 
dles with Mq = —23 mag and om = 0.4 mag. Bolometric 
magnitudes are first assumed and the Einstein-de Sitter 
model with Hq = 50 km/s/Mpc is used (the exact value 
of Hq is not relevant). Then the distance modulus is p = 
51og(l + 2 — (1 + z) 1 / 2 ) + 45.4 and the co-moving volume 
derivative is ^ oc ((1 + z) 1 ! 2 — 1) 2 /(1 + z) 5 / 2 . 

Using these relations in Eqs. (4) and (6), with p(z) = 
constant (no number evolution), we calculate the logarith¬ 
mic distribution of apparent magnitudes a(m) as shown in 
Fig.l (an arbitrary zero-point) and the average M at differ¬ 
ent observed to, or (. M) m . The slope of log a(m) is indicated 
for a few apparent magnitudes. Note the expected classical 
slope 0.6 at bright magnitudes (low redshifts). 

Calculation shows that the expression Mq — 
(dloga(m)/dTO)/0.6 x 1.382<r| f indeed reproduces the 
numerically calculated (M) m (see the upper part of Fig.l). 

Of course, this agreement is just as expected from the 
derived Malmquist relation. However, in presenting Fig. 1, 
we wish to underline several aspects. In the distribution 
a(m), to is the observed, uncorrected apparent magnitude. 
The difference ( M) m — Mq for intrinsic absolute magni¬ 
tudes can be derived without detailed information on the 
Friedmann model in question. This is also true for some 
number evolution (p(z)). As the slope of loga(?n) decreases 
starting from 0.6, the Malmquist bias decreases for this 
model as well. 

Figure 2 presents similar calculations, but now assum¬ 
ing finite-band apparent magnitudes subject to a K-effect. 
For simple illustration, the K-correction is taken to be 

2 For a class of identical objects (M = Mo), 4> oc the Dirac 

(5-function, and the convolution results in a(m) oc F(m — Mo). 
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Fig. 1. log a(m) vs. bolometric magnitude m (Eq.(4)) for 
a standard candle with Mq = —23.0 and om = 0.4 mag 
(the E-deS model, see text). The upper figures above the 
curve are the mean values (M) m calculated from Eq. (6) 
for to = 8, 16 and 22 mag, respectively. The lower figures 
(A) are the Malmquist bias values as calculated from the 
slopes shown below the curve. 
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Fig. 2. loga(?n) vs. finite-band apparent magnitude m for 
a Gaussian standard candle. Here the K-effect needed in 
the calculations of a(m) and the average absolute mag¬ 
nitude (. M) m corresponds to the correction K(z) = 2.52. 
Other parameters have the same values as in Fig.l. This 
and Fig.l also show roughly where the redsliift distribution 
peaks around to = 22 mag. 


K(z) = 2.5 z mag, roughly like for elliptical galaxies in op¬ 
tical wavebands (Coleman et al. 1980), making them ap¬ 
parently fainter than would be the bolometric expectation 
at increasing redshifts. Again, here a(m) is the raw distri¬ 
bution of observed magnitudes, without the K-correction. 


3.2. Comparison with the bias analysis in T98 

We have explained what happens to the Malmquist bias 
in cosmology in terms of the luminosity distance and the 
corresponding comoving volume (T98). As the cosmological 
distances and volumes are related in a way different from 
the classical distances, the bias is generally not constant in 
Friedmann models, but depends on apparent magnitude. 

In the cited analysis, instead of (M ) m , we calculated the 
quantity (logz) m , which is directly suitable to analyse the 


Hubble log z vs. m diagram. A uniform spatial distribution 
was assumed with no comoving number evolution. 

We conclude that the curves of Mattig (119581) for 
Friedmann models need to be corrected for a non-constant 
Malmquist bias in the logz vs. m Hubble diagram (T98; 
also Bigot & Triav IT95P1) . 

It was found that at bright m (low z) the Malmquist 
shift is close to classical, as expected. Then it generally 
decreases (in absolute value) towards fainter magnitudes. 
The same can now be seen from the Malmquist relation. 

When changing the model for example by adding the 
cosmological constant A, one simply asks how the slope 
of the counts a(m) changes. While the comoving volume 
derivative V'(z) becomes steeper with increasing z when 
a positive A is added, (tending to increase the slope), the 
luminosity distance also increases (diminishing the slope). 

The rapidly increasing volume is more important; it re¬ 
sults in steeper a(m), which means a larger Malmquist bias, 
that is, closer to the classical one. For example, referring to 
Fig.l, at m = 22 mag the pure flat A model, = 1, would 
lead to the bias —0.15 instead of —0.08 for the E-deS flat 
model. Thus the A-model leads to a weaker m-dependence 
of the bias, as also derived in T98 and T03. 

For the K-effect, it was pointed out in T98 that if K{z) 
increases with z so that the objects become fainter quicker 
than when they are only due to the bolometric factor, then 
the backside volume effectively decreases and the trend in 
the Malmquist bias away from the classical case increases, 
as also seen here in Figs. 1 and 2. The K-effect can be 
important and increase the deviation of the bias from the 
classical constant value. 

3.3. Practical note 

That we can derive the difference of the intrinsic magni¬ 
tudes (M) m and Mq in principle from minimal information 
(<tm) and raw data (a( to)) does not mean that we may gen¬ 
erally forget factors such as the K-correction when applying 
this result. 

For example, we consider a Gaussian standard candle 
in a test of the Friedmann model, assuming that we have 
been able to determine ci{m ) and know om- 

At the observed m the average (M) m is predicted to be 
Mq — o'M d y • This value is compared with the average 
(M) TOi data derived from the K-corrected apparent magni¬ 
tudes of the objects at the observed (uncorrected) mag¬ 
nitude to. Each object has a known redshift, so one may 
calculate for each its K-corrected absolute magnitude for a 
given Friedmann model. Therefore the test requires know¬ 
ing K(z) and the expression for the luminosity distance. 

Referring to Fig. 2, one might have derived the slope 
0.46 at to = 16 and hence the bias —0.17 mag. Then 
the Friedmann model is correct, which gives (M) i6,data = 
—23.17 mag, as derived from the K-corrected apparent mag¬ 
nitudes of the objects at the uncorrected to = 16 mag. 

With all the data, one requires that the difference 

A M m = (M) m , data - (M 0 - ^M dln d ^ m) ) (16) 

does not depend on m. In addition, (A M m ) « 0 for the 
correct Hubble constant and M o .0 

3 The same is valid in stellar statistics if the Malmquist rela¬ 
tion is to be used to derive the mean absolute magnitude of a 
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4. Concluding remarks 

Malmquist (119361) reported that his relation is also valid 
when light extinction is added to the static Euclidean space 
he considered. His study inspired the present work, which 
shows the scope of the Malmquist relation from classical 
situations to Friedmann cosmological models. 

The cosmological factors (luminosity distance, comov¬ 
ing volume derivative, and number evolution) are all re¬ 
flected in the slope of the (log) counts vs. observed apparent 
magnitude. The K-effect for finite-band magnitude and also 
possible ^-dependent extinction are automatically included 
in the right side of the Malmquist relation. 

We emphasized conceptual aspects of the Malmquist 
relation in view of its important role in stellar statistics. 
However, prospects for its practical use for high-luminosity 
objects in extragalactic astronomy are not so immediate. 

First, a constant Gaussian LF is rare or absent for ob¬ 
jects found at low and high redshifts. Second, it requires 
many data to dermine d with good accuracy. In ad¬ 

dition, the Type 1 Malmquist analysis is too simplistic if 
the objects are not detected on the basis of non-variable 
brightness, but there is a chain of measurement and lumi¬ 
nosity inference as for la supernovae. 

The Type 2 approach is often applied in luminosity- 
bias analysis in extragalactic astronomy, where the redsliift 
offers a good relative distance indicator. This concerns the 
classical determination of the Hubble constant as well as the 
detection of universal acceleration from the Hubble diagram 
of la SNe (e.g., Perrett et al. 12010 ). Bayesian approaches 
are also currently used when considering general LFs and 
inferring cosmological model parameters (e.g., March et al. 
I20TT1) . 

The Malmquist correction may be viewed as a Bayesian 
approach to the problem of deriving ( M) m (and perhaps 
using it in distance estimation) when the standard can¬ 
dle has a known Gaussian LF as prior, while the Type 2 
approach corresponds to the frequentist view of probabil¬ 
ity (Hendry & Simmons 1994). In the Gaussian case, the 
mean value of the posterior distribution P(M \ m) in the 
Bayesian formula 

P(M | m)P(m) = P(m \ M)p(M) (17) 

can be solved directly, essentially following Sect.2. 
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Fig. A.l. Differential Malmquist relation as applied to the 
case of a cluster at distance modulus p = 10. The LF is 
Gaussian with Mq = —5 and a = 1 mag. The slope of 
the In a(m) curve at any m, multiplied by <j 2 , gives the 
difference mo — m. 

to a Gaussian function with the mean mo = Mq + p(zo) 
and is observed up to the sample limit mii m . The second 
term in the right side of Eq. (9) for any m < my lm becomes 
after derivation m — Mq — p(zq) = M m — Mq. This is equal 
to (M) m — Mo in this case and gives the difference between 
m and the magnitude mo corresponding to the maximum 
of the LF at Mq even if this is not reached by the sample. 

The slope of the In a(m) distribution at any m gives, via 
the Malmquist Eq.(9), the absolute magnitude M m corre¬ 
sponding to the observed m and hence the distance modu¬ 
lus (see Fig. A.l for a graphic representation). For a good 
Gaussian LF the same result is obtained for any other m 
in the complete part of the sample. 

It is interesting to note that in the same year as 
Eddington published his Eq. (1), Kapteyn (119141) discussed 
the derivation of the distance of a star cluster with a 
Gaussian LF. He considered the observational cut-off effect 
and derived an integral equation that took into account 
the magnitude limit mn m and contained the distance mod¬ 
ulus as unknown. Essentially, in that method the cluster is 
moved along the line of sight up to the distance modulus p 
where the observed average apparent magnitude is equal to 
the value predicted from p, mu m , and the known Gaussian 
LF. Of course, the end result will be the same as in the 
approach where the slope of In a(m) is used. 

In fact, the formula (69) in the study by Kapteyn is a 
special case of the Malmquist integral bias relation, Eq.(3). 
Therefore both the differential and integral bias relations 
by Malmquist are formally applicable to the extreme spatial 
distribution represented by z = constant. 


Appendix A: Case of a cluster (z = const.) 

In the integrations of Sect.2 (e.g., in Eq. 4) integration can 
be restricted to a finite z range (where the objects in ques¬ 
tion exist). The density law p(z) takes care of this. 

Equation (9) also applies for a (5-function-like p(z), for 
instance, for a cluster at z = zq. Then a(m ) is proportional 

stellar class. (M) data — Mo is derived from the histogram of the 
apparent magnitudes. Then to infer Mo, (M )data must be com¬ 
puted, which requires distances and extinctions for each sample 
star. 
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